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A table in this brief contains a correction. 


For years, federally driven school classification systems focused almost entirely on test 
scores. This was done by design to emphasize critical reading and math skills and to 
make systems simple, transparent, and objective. With time, however, it became clear 
that this framework was too rigid. Parents and stakeholders viewed school quality 
through a wider lens, and state systems overlooked important elements such as school 


culture and climate. 


The bipartisan Every Student Succeeds Act of 2015 (ESSA) ushered in a new way to 
improve K-12 schools.’ ESSA promised states the opportunity to create more holistic 
school classification systems using new measures of school quality or student success— 
without losing sight of academic achievement. 


Some states had already started down this path, broadening the measures they used 

to assess school quality in response to federal education policy changes made in 2011 
through the Obama administration’s No Child Left Behind waivers.” Building on this 
progress, ESSA requires all states to rethink their school classification systems in consul- 


tation with community members. 


By the start of the 2017-18 school year, states must complete their plans to meet ESSA’s 
requirements. So far, 16 states and Washington, D.C., have submitted their plans to the 
U.S. Department of Education, which must review and approve them before they are 
put into action. The remaining 34 states—plus Puerto Rico and the Bureau of Indian 
Education—must submit their plans by September 2017 to undergo this same process.* 


As plans roll in, policymakers, advocates, and other stakeholders have their eye on 
certain policies, including how states expand their classification indicators to include 
measures other than test scores and graduation rates. This issue brief explores which 


new indicators of school quality or student success states use and how they include 


1 Center for American Progress | Measuring Success 


them in their school classification systems. States are also considering including them in 
their accountability systems outside of school classifications—for example, by publicly 
reporting and/or using data to inform the development of intervention and support 
plans. The brief concludes with recommendations for states as they finalize their plans. 


Indicator overview 
ESSA requires states to use at least five indicators to classify schools: 


1. Academic achievement in reading and math 

2. Another academic indicator, such as student growth in reading and math 

3. Four-year high school graduation rates, with the option to include extended-year rates 
4. Progress toward English language proficiency (ELP) 


5. At least one measure of school quality or student success 


The law gives states a handful of suggestions for the fifth indicator, including student 

or educator engagement; student access to and completion of advanced coursework; 
student postsecondary readiness; school climate and safety; or any other measure that 
meets the law’s technical requirements. States also have the flexibility to use multiple 
indicators or to use multiple measures within each indicator of school quality or student 
success. Throughout this brief, the terms “measures” and “indicators” are used inter- 


changeably, unless referring to multiple measures—or components—of one indicator. 


This brief considers any indicator to be an indicator of school quality or student success 
if it does not measure: academic achievement or student-level growth on state assess- 
ments in all academic subjects—see the “Indicator analysis” section for more; four-, 
five-, six-, or seven-year graduation rates; or ELP. It organizes school quality or student 
success indicators into the four categories below and analyzes how much each category 
contributes to school ratings, on average, in statewide school classification systems.* 


1. Early warning indicators 
2. Persistence indicators 
3. College- and career-readiness indicators 


4. Enrichment and environment indicators 


Every state includes at least one indicator from the four categories, and a handful of 
plans—Washington, D.C’s, Louisiana’s, Massachusetts’s, New Mexico's, and North 
Dakota’s—will use at least one indicator from each category.*° Overall, the 17 submitted 
ESSA plans include nearly 40 indicators—measured in a variety of ways—across all four 
categories of indicators.° On average, these measures contribute to around 20 percent 


of school ratings.’ For state-specific information, see CAP’s “School Accountability in 
First-Round ESSA State Plans.” 
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TABLE 1 
Number of states using measures of school quality 
or student success, by category 


Category Number of states 
Early warning indicators 16 
Persistence indicators 7 
College- and career-readiness indicators 13 
Enrichment and environment indicators 13 


Note: This analysis excludes four- and extended-year graduation rates from the persistence indicators category. 


Source: Data are based on author's analysis of ESSA state plans. See U.S. Department of Education, “ESSA State Plan Submission,’ available at https:// 
ed.gov/admins/lead/account/stateplan17/statesubmission.html (last accessed July 2017). 


TABLE 2 
Average weighting of school quality or student success indicators across 
states, by category 


Category Average percentage of weightings 
Early warning indicators 10% 
Persistence indicators 8% 
College- and career-readiness indicators 20% 
Enrichment and environment indicators 11% 


Note: This analysis excludes four- and extended-year graduation rates from the persistence indicators category. Average percentages exclude indicator 
weightings that could not be unpacked from other categories of indicators or that are not yet finalized. Average percentages also exclude indicators 
that are not weighted. 


Source: Data are based on author's analysis of ESSA state plans. See U.S. Department of Education, “ESSA State Plan Submission,’ available at https://ed.gov/ 
admins/lead/account/stateplan17/statesubmission.html (last accessed July 2017). 


Early warning indicators 


Sixteen states use an early warning indicator, which = TABLE3 


helps educators identify at-risk students. Thirteen Early warning indicators 


states use a measure of chronic absenteeism; four Number of states Weighting 
states measure attendance; and seven states include 8 0% through 10% 
an “on track to graduate” measure. Of these states, Z 11% through 20% 
early warning indicators are an average of 10 per- 0 21% through 30% 
cent of school ratings.* 4 31% through 40% 
0 41% through 50% 


> « 


For example, Connecticut's “on track to graduate” 


Note: Four states are excluded from this figure. The 


indicator measures the percentage of ninth-graders weighting of Arizona and North Dakota’s early warn- 


ing indicators could not be unpacked from another 


earning at least five full-year credits.’ Massachusetts, category of indicators. The weighting of Delaware's early 


warning indicators is not yet finalized, and Michigan will 


on the other hand, measures the percentage of not weight its indicators. 
. 10111: z Source: Data are based on author's analysis of ESSA state 
students who fail a ninth-grade course. Illinois uses plans. See U.S. Department of Education, “ESSA State 


Plan Submission, available at https://ed.gov/admins/ 


a hybrid approach, counting students as on track if lead/account/stateplan17/statesubmission.html (last 
accessed July 2017). 

they earn at least five full-year course credits in ninth 

grade and no more than one semester F in a core 


course their first year of high school." 


3 Center for American Progress | Measuring Success 


TABLE 4 
Early warning indicators 


First round, ESSA state plans 


Indicator State-defined measures State 
Daily average percentage of enrolled students who were present in school D.C. 
Percentage of students who have regular attendance ME 

Attendance 95 percent attendance, not counting school-related absences (included in choice- ND 


ready framework, see college- and career-readiness indicators) 


95 percent attendance, junior and senior year (included as requirement in composite 


college- and career-readiness indicator) 7 
Percentage of students absent for 10 percent or more of the school year AZ, CO, CT, DE, IL, MA, 
(excused absences vary by state) MI, NJ, NM, OR, TN 
Chronic absenteeism Percentage of students missing 18 school days or more during the school year NV 
Percentage of enrolled students who were present for 90 percent or more of DC 
enrolled days or growth in 90 percent attendance ma 
Percentage of ninth-graders earning at least five full-year credits in the year CT 
Percentage of ninth-graders earning at least five full-year credits and no more than IL 


one semester F in a core course in their first year of high school 


Percentage of ninth-graders earning four or more combined credits in at least four 
of the following subjects: English language arts; mathematics; science; social studies; DE 


and/or world languages 
On track to graduate 


Percentage of first-time ninth-graders who earn at least one-quarter of their required 


graduation credits at the end of their first year in high school OF 
Credit accumulation index (up to seven or more credits) LA 
Percentage of students that fail a ninth-grade class MA 
Number of students at the end of eighth grade with required units of credit NV 


Source: Based on the author's review of the submitted consolidated state plans of 16 states and Washington, D.C., under the Every Student Succeeds Act. See U.S. Department of 
Education, “ESSA State Plan Submission,’ available at https://www2.ed.gov/admins/lead/account/stateplan17/statesubmission.html (last accessed July 2017). 


Persistence indicators 


ESSA requires states to use at least the four-year TABLE 5 
adjusted cohort graduation rate for high school Persistence indicators 
ratings, and 13 states include an optional extended Number of states Weighting 
cohort graduation rate, such as five-, six-, or seven- A 0% through 10% 
year rates. In addition, seven states include per- 3 119% through 20% 
sistence indicators beyond what the law requires, 

0 21% through 30% 
which this analysis considers to be measures of 

. 0 31% through 40% 

school quality or student success. For example, 

0 41% through 50% 


three states use a dropout measure, and six states 
: : 3 : e Note: One state—Louisiana—is excluded from this fig- 
include alternate or modified graduation indictors ure, because the weighting of its persistence indicators 
z E cannot be unpacked from the weighting of its college- 
such as GED diploma attainment. Of these seven and career-readiness indicators 
Source: Data are based on author's analysis of ESSA state 
plans. See U.S. Department of Education, "ESSA State 
Plan Submission, available at https://ed.gov/admins/ 


c : 12 
age of 8 percent of high school ratings. lead/account/stateplan17/statesubmission.html (last 
accessed July 2017). 


states, additional persistence indicators are an aver- 
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Oregon, for example, uses a five-year high school completion rate, which is the per- 
centage of students earning a diploma, an extended diploma, a GED diploma, or an 
adult high school diploma. This indicator will also help the state designate alternative 
and youth correction schools—where students often need more time to complete a 


degree—for comprehensive or targeted support and improvement." 


TABLE 6 
Persistence indicators 


First round, ESSA state plans 


Indicator State-defined measures State 


Percentage of students enrolled in grades 7 through 12 who leave school 
during a single school year without subsequently attending another school or co 
educational program. 
Dropout rate 
P Annual dropout rate. MA 


Dropouts accrue zero points in credit accumulation index (see early warning 


indicators). ae 
Five-year cohort graduation rate plus percentage of students still enrolled in high MA 
school. 
Number of total graduates (regardless of time frame) divided by the number of DC 
students in the four-year adjusted cohort graduation rate. 
Five-year high school completion rate, defined as the percentage of students 
Alternate or modified earning a diploma, a modified diploma, an extended diploma, a GED diploma, or OR 
graduation indicator an adult high school diploma. 
High School Equivalency Test (HiSET) or HiSET plus any Career and Technical LA 
Education credential. 
Growth in four-year adjusted cohort graduation rate. NM 
Rate of GED diploma completion. ND 


Source: Based on the author's review of the submitted consolidated state plans of 16 states and Washington, D.C., under the Every Student Succeeds Act. See U.S. Department of 
Education, “ESSA State Plan Submission,’ available at https://www2.ed.gov/admins/lead/account/stateplan17/statesubmission.html (last accessed July 2017). 


College- and career-readiness indicators 


Thirteen states will include a measure of college and career readiness in their school clas- 
sification systems.'* Broadly, these indicators include participation in or performance 

on advanced coursework or postsecondary entry exams; career preparedness measures; 
postsecondary outcomes; and other measures of postsecondary readiness, such as GPA 
or high school diploma pathways. Of states that include these measures, college- and 


career-readiness indicators are, on average, 20 percent of high school ratings.’° 
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TABLE 7 
College- and career- 
readiness indicators 


Many states use a college- and career-readiness 
index or rubric. Arizona schools, for example, 


can earn up to two points per graduating senior 


based on a variety of indicators, including meeting  Numberofstates —— Weighting 

SAT or ACT cut scores and benchmarks for ACT 2 0% through 10% 
WorkKeys assessments, which measure work- 5 11% through 20% 
place skills.'° Louisiana schools earn index points 3 21% through 30% 
based on the strength of the diploma that students 0 31% through 40% 
receive, from a high school equivalency credential 1 41% through 50% 


to a high school diploma plus an associate degree.'’ 


Note: Two states are excluded from this figure. The 


North Dakota’s choice-ready framework, on the weighting of Delaware's college- and career-readiness 


indicators is not yet finalized, and Michigan will not 
weight its indicators. 


other hand, measures the percentage of students 


Source: Data are based on author's analysis of ESSA state 


who are on track to graduate through three path- plans. See U.S. Department of Education, “ESSA State 


Plan Submission, available at https://ed.gov/admins/ 


— ij lead/account/stateplan17/statesubmission.html (last 
ways—college ready, career ready, and military Seer 


ready—each with unique requirements." 


TABLE 8 
College- and career-readiness indicators 


First round, ESSA state plans 


Description Indicator State-defined measures State 


Percentage of students in grades 11 and 12 who participate in two Advanced Placement (AP), International 


Gi 
Baccalaureate (IB), or dual enrollment courses. 
Percentage of students taking at least one AP or IB exam. D.C. 
Advanced Percentage of students who successfully complete advanced courses (defined as AP, IB, honors, etc.) ina MA 
coursework school year. 
each eee P f students in grades 11 and 12 fully completing advanced k (dual enroll 
participation ercentage of students in grades 11 an successfully completing advanced coursework (dual enrollment, MI 


early middle college, Career and Technical Education (CTE), AP, and IB). 


Composite indicator that includes percentage of graduates completing four early postsecondary opportunities 
(EPSOs), including: AP; Cambridge International Examinations (CIE); College Level Examination Program (CLEP); TN 
dual enrollment; IB; local dual credit; and statewide dual credit. 


Percentage of students in grades 11 and 12 who attained benchmark scores on AP or IB exam. cT 


Advanced Students earn points in college- and career-readiness indicator menu for meeting cut score on any AP exam. AZ 


coursework a ; fo ; : 
Students earn points in college- and career-readiness indicator menu for passing college-level English, math, 


science, social studies, or a foreign language course for which college credit can be earned with an A, a B, or aC— AZ 
that is, dual enrollment and concurrent enrollment. 


Students earn points in college- and career-readiness indicator menu for meeting cut score on CLEP; Cambridge 


Advanced A or AS; or IB English, math, social studies, science, or foreign language exam. we 
coursework 
or exams— Percentage of students who score 3+ on at least one AP exam and/or 4+ on at least one IB exam. D.C. 
performance 
An AP exam of 3 or better—included in Delaware's composite indicator that measures the number of grade 12 
students meeting one or more of eight college- and/or career-preparedness options divided by the total number 
of grade 12 students; included in North Dakota's choice-ready framework, which measures the percentage of DE, ND, 
students who are on track to graduate by meeting multiple requirements in three different pathways; included VT 
in Vermont's composite indicator that measures the number of graduates in each school that have met 1 of 8 
college- and career-readiness options divided by the total number of graduates. 
Scoring a 4 or better on an IB exam (included in composite indicator and choice-ready framework, see above). DE, ND 
(continues) 
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Description Indicator State-defined measures State 


Earning postsecondary credit attainment with a B or higher outside of a state-approved program of study 


é s ae DE 
(included in composite indicator, see above). 
An English language arts AP exam score of 3 or better (included as an option in composite college- and career- iL 
readiness indicator that has a menu of indicators for several pathways). 
A math AP exam score of 3 or better (included as an option in composite college- and career-readiness indicator, iL 
see above). 
A,B, or Cin an English language arts AP course (included as an option in composite college- and career-readiness IL 
indicator, see above). 
A,B, or Cina math AP course (included as an option in composite college- and career-readiness indicator, IL 
see above). 
A,B, or Cina dual credit English course (included as an option in composite college- and career-readiness IL 
indicator, see above). 
A,B, or Cina dual credit math course (included as an option in composite college- and career-readiness indicator, IL 
Advanced see above). 
Advanced coursework An English language arts IB exam score of 4 or better (included as an option in composite college- and career- 
coursework or exams— : ee IL 
. readiness indicator, see above). 
(continued) performance 
(continued) A math IB exam score of 4 or better (included as an option in composite college- and career-readiness indicator, iL 
see above). 
Earning an A, aB, ora C in algebra 2 (included as an option in composite college- and career-readiness indicator iL. ND 
and choice-ready framework, see above). ' 
Passing AP/IB/CLEP score (part of an index that awards points to students based on the strength of diploma LA 
received). 
At least one passing course grade for core curriculum credit in AP, college credit, dual enrollment, or IB LA 
(included in strength-of-diploma index, see above). 
Earning an A, aB, ora Cin an AP course (included in choice-ready framework, see above). ND 
Earning an A, aB, or a Cina dual credit course (included in choice-ready framework, see above). ND 
Score of 50 or higher on CLEP assessments (included in composite indicator, see above). VT 
Score of 24 points or higher on IB assessments (included in composite indicator, see above). VT 
Cor better in any accredited college course (included in composite indicator, see above). VT 
Percentage of students in grades 11 and 12 who attained benchmark scores on SAT or ACT exam. CT 
Students earn points in college- and career-readiness indicator menu for meeting cut score on ACT English, AZ 
math, reading, or science exam. 
Students earn points in college- and career-readiness indicator menu for meeting cut score on SAT English AZ 
or math exam. 
Students earn points in college- and career-readiness indicator menu for meeting cut score on the ACCUPLACER 
assessments; the Assessment and Learning in Knowledge Spaces program; the COMPASS test; or the Cambridge AZ 
International General Certificate of Secondary Education English program; and reading, writing, math, social 
Penfarnanccran studies, science, or foreign language exam. 
Postsecondary 
entry exams college entry exams, Percentage of students meeting or exceeding the college-ready benchmark on the SAT or ACT. D.C. 
such as SAT or ACT 
Percentage of students meeting or exceeding a percentile threshold as determined by the state. D.C. 
SAT college- and career-readiness benchmarks (SAT essay) (included in composite indicator, see above). DE 
ACT score of 30 or SAT score of 1400 (included as an option in composite college- and career-readiness indicator, IL 
see above). 
Minimum ACT subject scores of English—18—and reading—22 (included as an option in composite college- iL 
and career-readiness indicator, see above). 
Minimum ACT subject scores of math—22—plus math in senior year (included as an option in composite college- IL 
and-career-readiness indicator, see above). 
Minimum SAT subject score of evidence-based reading and writing: 480 (included as an option in composite IL 
college- and career-readiness indicator, see above). 
(continues) 
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Description Indicator State-defined measures State 


Minimum SAT subject score of math—530—plus math in senior year (included as an option in composite college- 


and career-readiness indicator, see above). I 
ACT/WorkKeys index with 20 levels of performance.* LA 
Average ACT composite score. NV 
ACT English score of 18 and math score of 21 (included in choice-ready framework, see above). ND 
Dapiencandar Performance on 
y college entry exams, SAT reading and writing score of 480 and math score of 530 (included in choice-ready framework and composite 
entry exams ait ND, VT 
. such as SAT or ACT indicator, see above). 
(continued) (continued) 
College Lab for English and Math/CREAM Pearson English—70 percent—and math—70 percent (included in ND 
choice-ready framework, see above). 
Composite ACT score of 22 or higher (included in choice-ready framework, see above). ND 
Composite ACT score of 21 (included in composite indicator, see above). VT 
Composite indicator that includes percentage of students scoring 21 or higher on ACT. TN 
Percentage of students in grades 11 and 12 who participate in two courses in 1 of 17 CTE categories or two cT 
workplace experience courses. 
Students earn points in college- and career-readiness indicator menu for completing well-defined work-based AZ 
learning experience of at least 120 hours. 
Completing an approved cooperative education and/or work-based learning extension (included in composite DE 
Participation in CTE indicator, see above). 
casks. Job tally, Workplace learning experience (included as an option in composite college- and career-readiness indicator and 
or workplace : : IL, ND 
: ; in choice-ready framework, see above). 
learning experiences 
Completion of a program of study (included as an option in composite college- and career-readiness indicator, IL 
see above). 
Percentage of students in grades 11 and 12 successfully completing advanced coursework (dual enrollment, MI 
early middle college, CTE, AP, and IB). 
Complete two credits in a coordinated plan of study (included in choice-ready framework, see above). ND 
Students earn points in college- and career-readiness indicator menu for earning an industry-recognized AZ 
credential, certificate, or license. 
Students earn points in college- and career-readiness indicator menu for completing a CTE sequence and AZ 
passing the state-specific technical skills assessment for that sequence. 
Career Students earn points in college- and career-readiness indicator menu for completing a CTE course sequence AZ 
preparedness with an A, aB, ora C (outside of completed sequence referenced above). 
State department of education-approved industry credential (included in composite indicator, see above). DE 
Postsecondary credit attainment with a B or higher within a state-approved program of study (included in DE 
composite indicator, see above). 
Earning an industry- sai and Le Pathway Endorsement (included as an option in composite college- and career-readiness iL 
recognized credential indicator, see above). 
or certificate, ahs Industry-recognized credential (included as an option in composite college- and career-readiness indicator and iL. VT 
performance in in composite indicator, see above). : 
CTE courses 
Industry-aligned and state board-approved CTE credentials. NV 
Dual Credit Career Pathway Course (A or B grade)— included as an option in composite college- and career- IL 
readiness indicator, see above. 
Advanced statewide CTE credential (included in strength-of-diploma index, see above). LA 
Basic statewide CTE credential (included in strength-of-diploma index, see above). LA 
Technical assessment/industry credential (included in choice-ready framework, see above). ND 
Career Ready Practice (3.0)—included in choice-ready framework, see above. ND 
Composite indicator that includes percentage of students completing two EPSOs and earning industry TN 
certification. 
(continues) 
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Description Indicator State-defined measures State 


Consecutive summer employment (included as an option in composite college- and career-readiness indicator, 


Summer employment saecheuAl, IL 
Students earn points in college- and career-readiness indicator menu for meeting benchmarks for ACT WorkKeys. AZ 
Performance on ; : ¥ 
ACT WorkKeys ACT/ACT WorkKeys index with 20 levels of performance. LA 
WorkKeys (Gold or Silver). ND 
Career Students earn points in college- and career-readiness indicator menu for meeting benchmarks for ASVAB. AZ 
preparedness 
(continued) ASVAB Armed Forces Qualification Test (AFQT) score of 50 (included in composite indicator, see above). DE 
Performance on Armed —ASVAB score of 31 or higher (included in choice-ready framework, see above). ND 
Services Vocational f 4 di aeinch a f act , 
Aptitude Battery (ASVAB) ASVAB performance (depending on branch—minimum scores range from 31 to 36; included in composite VT 
indicator, see above). 
Composite indicator that includes percentage of students completing two EPSOs and scoring a state-determined TN 
designated score on the ASVAB AFQT. 
Schools earn a bonus point in college- and career-readiness indicator menu for increasing the percentage AZ 
of postsecondary enrollment or 85 percent postsecondary enrollment and/or military enlistment. 
Percentage of graduating class that enrolled in a two- or four-year postsecondary institution any time during CT 
the first year after high school graduation. 
Postsecondary 
enrollment Percentage of students enrolling in postsecondary education within key time points. MI 
College persistence (in consideration). NM 
College enrollment (included in summative indicator that counts the postsecondary outcomes of graduates VT 
divided by the number of graduates at 16 months after graduation). 
Postsecondary 
outcomes Attaining and maintaining consistent employment for a minimum of 12 months (included as an option in IL 
Trade school or composite college- and career-readiness indicator, see above). 
workforce enrollment 
Enrollment in trade schools and the workforce (included in summative indicator, see above). VT 
Military service (including ROTC)—included as an option in composite college- and career-readiness indicator, see IL 
above). 
Military enrollment Military enlistment (included in summative indicator, see above). VT 
or service 
Schools earn a bonus point in college- and career-readiness indicator menu for increasing the percentage of 
postsecondary enrollment or 85 percent postsecondary enrollment and/or military enlistment (same indicator as AZ 
above). 
GPA of 3.75 to 4.0 (included as a requirement for one pathway in composite college- and career-readiness IL 
indicator, see above). 
GPA of 2.8 to 4.0 (included as a requirement for one pathway in composite college- and career-readiness indicator, IL 
GPA see above). 
GPA of 2.8 or higher (included in choice-ready framework, see above). ND 
GPA of 3.0 or higher in the core course requirements for university admission (included in choice-ready framework, ND 
Other see above). 
raring Students earn points in college- and career-readiness indicator menu for meeting all 16 Board of Regents program- AZ 
of-study requirements 
measures 
Students earn points in college- and career-readiness indicator menu for earning a college- and career-readiness AZ 
F diploma or an IB diploma. 
High school 
diploma pathways High school diploma plus associate degree (included in strength-of-diploma index, see above). LA 
High school diploma earned through pathway for students who take the LEAP Alternate Assessment Level 1 LA 
(included in strength-of-diploma index, see above). 
Standard diplomas are worth a value of 1; college-endorsed or career-endorsed diplomas earn a value of 1.25. NV 
(continues) 
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Description Indicator State-defined measures State 


Earning an A, aB, ora C in college remedial English (included as an option in composite college- and career- 


: en IL 
readiness indicator), see above. 
Remedial : : : ; eee ; 
Other Hetiiese Earning an A, a B, or a Cin college remedial math (included as an option in composite college- and career- IL 
postsecondary readiness indicator), see above. 
readiness 
measures College remediation (in consideration). NM 
(continued) Free Application 
for Federal Student Students earn points in college- and career-readiness indicator menu for completing the FAFSA. AZ 


Aid (FAFSA) 


*Correction, August 8, 2017: Table 8 has been updated to include the accurate state-defined measures for postsecondary entry exams and career preparedness. 


Source: Based on the author's review of the submitted consolidated state plans of 16 states and Washington, D.C.,, under the Every Student Succeeds Act. See U.S. Department of Education, "ESSA State Plan Submission; 
available at https://www2.ed.gov/admins/lead/account/stateplan1 7/statesubmission.html (last accessed July 2017). 


Enrichment and environment indicators 


Thirteen states will include measures of academic enrichment or school environment 

in their school ratings, ranging from measures of a well-rounded education to school 
climate.’? For example, four states include a measure of physical fitness and three states 
include access to or participation in arts or music. Four states will use a student engage- 
ment or climate survey, which consider a range of school environment conditions such 
as teacher support and school safety. One state—Arizona—considers whether students 
with disabilities are included in general classrooms. Three states—in addition to the 
law’s assessment requirements—use another cut of test score data such as improvement 
among subgroups of students, including those from low-income families, students from 
major racial and ethnic groups, students with disabilities, and English language learners. 


These indicators, on average, are 11 percent of school ratings.” 


Additionally, ESSA requires states to annually test = TABLE 9 
Enrichment and 


95 percent of students in reading and math, to use j ingen 
environment indicators 


the participation rate to calculate the achievement 


indicator, and to factor assessment participation Number of states Weighting 

into the statewide accountability system another 6 0% through 10% 
way.”' For example, four states—Connecticut, 2 11% through 20% 
Massachusetts, New Mexico, and Vermont—plan 1 21% through 30% 
to lower a school’s classification for not meet- 0 319% through 40% 
ing this requirement.” In three states—Illinois, ; 41% through 50% 


Nevada, and Tennessee—schools that do not 


Note: Four states are excluded from this figure. Two 


have a 95 percent participation rate cannot score states—Massachusetts and Tennessee—use enrichment 
and environment indicators (eg., test participation) only 
at the highest level of proficiency; receive zero for school ratings penalties. The weighting of Delaware's 


enrichment and environment indicators is not yet final- 
ized, and Michigan will not weight its indicators. 


points for proficiency; or receive an F on the 


Source: Data are based on author's analysis of ESSA state 


achievement indicator for the given group of plans. See U.S. Department of Education, "ESSA State 
Plan Submission, available at https://ed.gov/admins/ 
students, respectively.” lead/account/stateplan1 7/statesubmission.html (last 


accessed July 2017). 
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TABLE 10 


Enrichment and environment indicators 


First round, ESSA state plans 


Description Indicator State-defined measures States 
Percentage of students meeting or exceeding standards in all four areas of the state CT 
physical fitness assessment. 

Physical Amount of exposure to physical education. MI 
fitness Physically fit as deemed by physical education instructor (included in choice-ready a 
framework, see college- and career-readiness indicators). 
Student performance on physical fitness assessment. VT 
Percentage of students in grades 9 through 12 participating in at least one dance, CT 
theater, music, or visual arts course in the school year. 
Art Participation in fine arts courses. (Note: This is weighted at 0 percent for the next IL 
four years.) 
Amount of exposure students have to courses in the fine arts. MI 
Music Amount of exposure students have to music courses. MI 
F as Certificate of multiliteracy (included in composite indicator, see college- and 
Well-rounded Multiliteracy ; ee yl P g DE 
education career-readiness indicators). 
Two or more organized cocurricular activities (included as option in composite IL 
Cocurricular or college- and career-readiness indicator). 
extracurricular 
activities Two or more years in cocurricular or extracurricular activities (included in choice- ND 
ready framework, see above). 
Percentage of middle school students with an academic learning plan. NV 
fosnin Identify a career area of interest by end of sophomore year (included as a iL 
plas g requirement for one pathway in composite college- and career-readiness indicator). 
Rolling four-year education plan of study (included in choice-ready framework, ND 
see above). 
Community 25 hours of community service (included as option in composite college-and IL 
service career-readiness indicator). 
Library media : : coi 
es Access to a library media specialist. MI 
specialist 
Student (grades 6 through 12), parent, teacher, and administrator participation 
in 5Essentials Survey. (Note: Participation will be used until the survey can be IL 
disaggregated by student demographic group.) 
Climate survey Student participation in climate survey. NV 
Student (grades 3 through 11) responses to Opportunity to Learn survey. NM 
Student engagement survey. ND 
Culture and Percentage of students who are able and choose to re-enroll in the same school the 
climate Re-enrollment ; D.C. 
following year. 
Suspensions or 2 F : : : 
p p Zero expulsions or suspensions (included in choice-ready framework, see above). ND 
expulsions 
adeion Schools earn points in an acceleration menu if students spend at least 80 percent of AZ 
their day in general education classroom. 
Spee Program-level score on the Classroom Assessment Scoring System, an DC 
observational tool that assesses the quality of pre-K classroom interactions. ie 
(continues) 
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Description Indicator State-defined measures States 


Schools earn points in an acceleration menu for increasing the percentage of 


students in grades 5 through 8 accelerating in end-of-course math. ne 


Accelerating Students earn points in college- and career-readiness indicator menu for a passing 


in coursework score on algebra 2 or English language arts 11. 
or meeting 
performance Percentage of students achieving college- and career-readiness status on the math, 


benchmarks science, or English language arts end-of-course exams. 


AZ 


NV 


State assessment English 3 and math 3 (included in choice-ready framework, 


see above). ne 


Third-grade Schools earn points in an acceleration menu for decreasing percentage of 


reading minimally proficient third-graders. Ae 


Schools earn points in an acceleration menu for improving the performance 
of student subgroups (the school’s current year weighted, stable proficiency AZ 
compared with the prior year weighted, stable state average for the subgroup). 


Subgroup 
improvement 


Schools in the top two categories will be lowered a category if the participation 
rate on the state summative assessment in any subject for either the all-students CT 


group or the high-needs group is less than 95 percent. 
Other 
assessment Schools that do not have a 95 percent participation rate cannot score at the highest 


measures level of proficiency. 


General participation and English-language learner participation will be included 


Saal Ml 
as a school classification indicator. 


Schools that do not meet assessment participation requirements are eligible to 


MA 
move down a level on the performance scale. 


Test Three levels of participation rate penalties for schools that test fewer than 95 
participation percent of their eligible student population: participation warning (displayed with 
index score and star rating); participation penalty (status indicator reduced by NV 
significant number of points); and continuing participation penalty (schools earn 
zero points for the proficiency indicator). 


Schools that fail to test 95 percent of students in English language arts or math 


‘ : NM 
will have their overall letter grade reduced by one letter. 


Schools will receive an F on the achievement indicator for any group of students 


a TN 
that does not meet the 95 percent participation rate. 


If a school has lower than 95 percent participation, the school’s rating will be 
lowered by multiplying its preliminary score by the percentage of eligible students VT 
participating in the assessment. 


Source: Based on the author's review of the submitted consolidated state plans of 16 states and Washington, D.C., under the Every Student Succeeds Act. See U.S. Department of 
Education, “ESSA State Plan Submission,’ available at https://www2.ed.gov/admins/lead/account/stateplan17/statesubmission.html (last accessed July 2017). 


Indicator analysis 


ESSA requires that states give “substantial weight” to achievement, the second academic 
indicator, graduation rates, and ELP and “much greater weight” to those measures in the 
aggregate compared with school quality or student success indicators.” States’ inter- 
pretations of this requirement vary and may depend on how they label the indicators in 
their school classification systems. 
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For example, some states do not label any school classification indicators in their ESSA 
plans with the term “school quality or student success.’ Some states label some, but not 
all, of the indicators that qualify as measures of school quality or student success with 
this term. Other states include measures of school quality or student success within 
other indicators, such as the achievement indicator. The analysis in this brief considers 
all measures that qualify as measures of school quality or student success under ESSA— 


regardless of state plan organization or labeling—as this type of indicator. 


For example, in its initial submitted state plan, Washington, D.C., includes performance 
on the SAT or ACT and participation in and performance on Advanced Placement and 
International Baccalaureate exams in its achievement indicator. Nevada’ state plan, on 
the other hand, refers to its measures of college and career readiness and student engage- 
ment as “other indicators.” This analysis categorizes both sets of indicators as measures 
of school quality or student success.”® 


On the other hand, in order to comply with ESSA, states may use additional academic 
subjects such as science and social studies as the second academic indicator for elemen- 
tary and middle schools, or as an indicator of school quality or student success for any 
schools, according to initial feedback from the Education Department.” The analysis in 
this brief excludes these measures when identifying and weighting measures of school 


quality or student success. 


On average, states include school quality or student success indicators as approximately 
14 percent of elementary and middle school ratings and 26 percent of high school rat- 
ings.”” Prior to ESSA, these types of indicators similarly averaged around 20 percent 

of school classification systems.” Notably, two plans—Washington, D.C.’ and North 
Dakota’s—include measures of school quality or student success as more than SO per- 
cent of high school ratings.” The bulk of these measures are college- and career-readi- 
ness indicators, such as performance on the SAT, ACT, or ACT WorkKeys; participation 


or performance in advanced coursework; and earning industry-recognized credentials. 


Additionally, of the 17 submitted plans in this review, the majority of states are using 
new or different indicators compared with their systems prior to ESSA’s passage. For 
example, 11 additional states are using chronic absenteeism and seven more states 
use measures of college and career readiness. In addition, seven more states are using 
enrichment or environment indicators, such as measures of a well-rounded educa- 
tion. States have also introduced new indicators, such as re-enrollment, certificates 
of multiliteracy, participation in summer employment, and completion of the Free 
Application for Free Student Aid. One plan—Washington, D.C’s—includes a mea- 
sure of pre-K classroom quality.*° 
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Considerations 


States should keep several considerations in mind as they prepare to submit their plans 
to the Education Department for review or revise their plans based on initial depart- 
ment feedback. States may refer to the analyses in this brief as points of reference for 


indicators or weightings, in addition to the recommendations below. 


Simple systems 


States should create clear and simple classification systems. Parents, teachers, school 
leaders, and others need to be able to understand why their school receives a certain rat- 
ing and what it would need to do to improve. Including too many indicators may over- 
complicate ratings and dilute the amount of attention that the measures receive. ESSA 
allows states to use more than one measure of school quality or student success, which 
may give schools a greater opportunity to demonstrate school performance. But includ- 
ing a dozen indicators or complex indices may make it difficult for schools to know what 


to focus on, and each individual indicator may lose relevance. 


The classification determinations required under the law, however, are only a small part 
of an effective accountability system.*' Additional indicators can and should be used to 
drive a system of continuous improvement at the state, district, and school levels. Some 
states are developing data dashboards with a broad array of data points designed to 
inform improvement efforts at every level of the system. 


Discrete indicators 


States should avoid using measures of school quality or student success in other school 
classification indicators. For example, some state plans include measures of college and 
career readiness—such as participation in advanced coursework—in the achievement 
indicator or in the graduation rate indicator. The law requires that these measures be 
used in a distinct school quality or student success indicator; using these measures in 
other indicators may make it more difficult for parents to understand which indicators 


are being used and the respective weight given to them. 


Weighting requirements 


States should think critically about how to comply with the law’s weighting require- 
ments. The law requires that school classification systems lean heavily toward the 
academic indicators, compared with the measures of school quality or student success. 
Having clearly defined indicators will help states comply with this requirement so that 


nonacademic indicators don’t mask low performance on academic outcome measures. 
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Again, states can use these classification systems to zero in on the areas that need the 
greatest attention, but they can and should think more expansively about how to use a 
broad array of measures to support schools’ improvement efforts and provide parents 
with a fuller picture of school quality. 


Disaggregated data 


ESSA requires states to be able to disaggregate—or report results by each student 
group—all measures in their school classification systems, excluding progress toward 
ELP. Accordingly, states must ensure that they can disaggregate their new measures 

of school quality or student success to use them for school ratings. Until they can be 
broken down by student group, these measures will be better suited for public reporting 


and school improvement. 


Supporting all students 


States should consider whether their measures of school quality or student success sup- 
port all students. For example, many states have explored measures of college and career 
readiness at the high school level, but few have adopted measures of early learning to 
support younger students toward this goal. States may use different indicators for each 
grade span, which gives them the opportunity to be inclusive of all grades. 


Continuous improvement 


States should continue to update and improve on their plans after they submit them 

to the Education Department. ESSA gives states the flexibility to add new measures to 
their school classification systems over time. As a result, states should consider includ- 
ing additional indicators of interest once they have collected data for several years and 
confirmed that new instruments, such as climate surveys, are valid, reliable, and can be 


disaggregated for all student groups. 


Comprehensive data dashboards 


States should publicly report performance on additional indicators they use to measure 
school performance, not just those required for school classification under the law. These 
classifications are just one small part of effective accountability systems. A broad array 

of indicators of student and school success—that may not be appropriate to include in 
the classification system—can and should be used to inform improvement supports. 
Furthermore, some states are considering keeping the classification determinations 
focused on schools identified for intervention, rather than using them to rate or grade all 
schools. Additional data can be catalogued in comprehensive data dashboards for use by 


parents and district and school personnel for planning school improvement strategies. 
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Conclusion 


States have a world of opportunity as they redesign school classification systems under 
ESSA. But carefully choosing which new measures of school quality or student success 
to use is no small task. These measures should align with states’ long-term goals and 
signal their priorities, which require the time and attention of districts and schools. 


The first 17 plans submitted to the Department of Education include a variety of mea- 
sures, from chronic absenteeism and SAT performance to summer employment. These 
states can continue to improve their systems as new data become available, and states 
that have yet to submit their plans to the department can learn from the breadth and 
depth of new measures included in first-round plans. 


Appendix A: Methodology 


The author analyzed the ESSA plans that 16 states and Washington, D.C., submitted 

to the Department of Education, including updated plans, as of August 1, 2017." The 
analysis organizes the new measures of school quality or student success that states use 
in their school classification systems into four categories: early warning; persistence, 
other than four-year or extended-year graduation rates; college and career readiness; and 
enrichment and environment indicators. Some state systems use multiple measures in 
one indicator, index, or menu of options. This analysis considers each measure in these 
composite indicators as its own indicator. As a result, the analysis may reflect more indi- 
cators than how a state describes its system. This analysis may also categorize measures 
in ways that are different than state ESSA plan descriptions. 


This brief also explores how much measures of school quality or student success con- 
tribute to school ratings. Weightings for each category were calculated based on the total 
points or percentage points a school can earn for each indicator, or the relative weighting 
of each indicator if a system did not use a performance index. For states that described two 
phases of indicator weighting, the analysis used the weightings in their second phase. 


‘The ranges and averages for the early warning and enrichment and environment indica- 
tor categories include weightings for elementary, middle, and high schools. The ranges 

and averages for the persistence and college- and career-readiness indicators categories 
include high schools only. Averages do not include data from states that do not include 
or weight indicators in a respective category. Additionally, it was not always possible to 


unpack the weightings of measures that states include in composite indicators. 


Samantha Batel is a policy analyst with the K-12 Education team at the Center for 
American Progress. 


*Correction, August 8, 2017: Table 8 has been updated to include the accurate state-defined 


measures for postsecondary entry exams and career preparedness. 
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